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One  current  research  area  within  the  field  of  natural  language  processing  is 
concerned  with  the  nature  of  predictive  understanding  aechenisms  that  seek  to 
interpret  input  in  terms  of  knowledge-based  expectations.  A prsdictivs 
understanding  system  (human  or  computational)  builds  sn  Intsmal  rsF'rassntstlon 
for  narratives  by  generating  Inferences  and  making  casual  connections  between 
the  events  described  on  the  basis  of  ttiese  expectations.  Progress  In  this  arsa 
now  makes  it  possible  to  study  the  various  ways  that  processing  complexity  at 
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the  time  of  understanding  affects  the  memory  representation  generated  for  a 
text.  For  example,  memory  encodings  for  the  event,  "John  was  shot"  will  vary 
depending  on  whether  or  not  this  event  was  consistent  with  the  understander's 
expectations  (if  John  was  in  a duel),  inconsistent  (if  John  was  watching 
television) , or  overshadowed  by  a strong  context  (if  John  was  shot  along  with 
the  President  of  the  United  States).  In  each  of  these  cases,  interpretive 
processing  at  the  time  of  understanding  will  vary  significantly.  Using 
techniques  of  artificial  intelligence,  this  project  will  investigate  the  ways 
that  processing  at  the  time  of  understanding  can  affect  recall  behavior  in  the 
tasks  of  question  answering  and  paraphrase  production.  This  investigation 
will  focus  on  the  design  and  implementation  of  process-oriented  memory 
structures  in  a computer  program  that  understands  narratives.  The  results  of 
these  efforts  will  be  of  interest  to  researchers  in  cognitive  psychology  and 
linguistics  as  well  as  artificial  intelligence. 
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One  current  research  area  within  the  field  of  natural  language  processing 
is  concerned  with  the  nature  of  predictive  understanding  mechanisms  that 
seek  to  interpret  input  in  terms  of  knowledge-based  expectations.  A 
predictive  understanding  system  (human  or  computational)  builds  an  internal 
representation  for  narratives  by  generating  inferences  and  making  casual 
connections  between  the  events  described  on  the  basis  of  these 
expectations.  Progress  in  this  area  now  makes  it  possible  to  study  the 
various  ways  that  processing  complexity  at  the  time  of  understanding 
affects  the  memory  representation  generated  for  a 
memory  encodings  for  the  event,  "John  was  shot"  will  v 
whether  or  not  this  event  was  consistent  with  t 
expectations  (if  John  was  in  a duel),  inconsist 

television),  or  overshadowed  by  a strong  c90t«*ir'Tif  John  was  shot  along 
with  the  President  of  the  United  -States) . In  each  of  these  cases, 
interpretive  processing. .at  the  time  of  understanding  will  vary 
significantly.  ^Using  techniques  of  artificial  Intelligence,  this  project 
will  investigate  the  ways  that  processing  at  the  time  of  understanding  can 
affect  recall  behavior  In  the  tasks  of  question  answering  and  paraphrase 
production.^ This  investigation  will  focus  on  the  design  and  implementation 
of  process-oriented  memory  structures  in  a computer  program  that 

understands  narratives.  The  results  of  these  efforts  will  be  of  interest 
to  researchers  in  cognitive  psychology  and  linguistics 

artificial  intelligence. 
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1.  bdsksround  to  the  Problein 


The  proolej  of  text  comprenenslon  Is  traditionally  partitioned 
into  three  phases:  (1)  initial  understanding  or  encoding,  (2) 
retention  or  meiory  aalntai nance,  and  (3)  retrieval  for  the  purposes 
of  answering  a question,  producing  a paraphrase,  or  performing  some 
other  demonstrative  task.  A successful  demonstration  of  comprehension 
relies  on  competence  at  each  stage;  an  error  at  any  stage  can 
manifest  itself  in  the  retrieval  task,  although  It  is  not  always 
clear,  for  any  given  error,  exactly  where  the  processing  has  broken 
down.  Natural  language  processing  research  in  artificial  intelligence 
has  produced  process  models  for  text  comprehension  which  concentrate 
primarily  on  the  initial  encoding  [11,15,19,20,22,28,29,30,31]  and 
retrieval  phases  [12,13,29,311;  very  little  attention  has  been  given 
to  tne  retention  phase. 

Standard  strategies  for  the  Initial  encoding  phase  include 
syntactic  parsers  [11,15,29,30],  conceptual  analyzers  [16,18,19,25], 
predictive  knowledge  structures  [2, 6, 7, 9, 2«, 27],  and  story  grammars 
[21,26].  Much  of  the  work  in  this  area  is  very  recent,  but  already 
there  is  psycnological  evidence  substantiating  the  strategy  of 
conceptual  analysis  guided  by  predictive  knowledge  structures  [4j. 
Furtner  results  with  free  recall  experiments  have  argued  in  favor  of 
semantically-oriented  memory  representations  of  the  sort  generated  by 
knowledge-based  systems  while  arguing  against  the  story  grammar 
approach  [5].  Within  this  knowledge-based  viewpoint  the  recognition 
of  valid  causalities  between  events  is  thought  to  be  a central  factor 
affecting  memory  retention  [5,23]. 
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Various  knowledge  struoLures  nave  been  proposed  for  the  purpose 
of  text  oonprehension.  Minsky's  system  of  fraues  [16]  describes  a 
strategy  for  knowledge  application  on  a very  abstract  level,  while 
Jiore  concrete  foraulatl  ons  of  knowledge  structures  nave  been 
Investigated  via  coaputer  Implementations.  Tne  SAM  system  was 
designed  to  Investigate  tne  process  of  script  application  [9],  and  PAM 
was  implemented  to  illustrate  how  goal-oriented  analysis  aids 
understanding  [27].  Scripts  and  goals  are  two  types  of  Knowledge 
structures  proposed  oy  Scnanx  and  Abelson  [24]. 

Tne  aspect  of  knowledge-based  understanding  we  will  address  nere 
concerns  the  ways  in  which  encoding  processes  directly  affect 
retention  and  retrieval.  For  example,  the  von  Restorff  effect  has 
long  been  acknowledged  in  psychology:  strange  or  innerently 
interesting  events  within  a narrative  will  be  retained  for  long 
periods  of  time  and  recovered  in  free  recall  [d].  but  a precise 
mechanism  responsible  for  this  general  phenomenon  has  yet  to  oe 
proposed.  Exactly  now  is  s system  going  to  recognize  when  an  event  is 
strange  or  Inherently  interesting?  It  is  not  enough  to  know  if  an 
event  is  causally  coherent  in  a given  text  because  some  events  are 
both  Irrelevent  (not  causally  connected)  and  boring  (neitner  strange 
nor  interesting).  It  appears  that  some  further  explication  of  this 
Phenomenon  can  now  be  proposed  in  view  of  recent  research  on 
predictive  understanding  systems. 


We  also  know  that  cued  recall  will  elicit  more  information  from 
memory  than  free  recall  [d].  In  terms  of  text  processing,  this  means 
that  a person  answering  questions  about  a story  will  be  able  to 
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desDonstrate  retention  of  information  that  will  not  oe  included  Jn  a 
free  recall  parapnrase  of  the  same  story.  Depending  on  the  nature  of 
the  retrieval  taslc,  some  information  will  be  more  accessible  than 
others.  While  this  Initially  appears  to  be  no  more  than  a problem  in 
retrieval,  we  believe  that  encoding  processes  are  critical  in 
aetermining  the  variable  accessibility  of  Information  in  memory. 

In  this  paper  we  will  outline  a strategy  for  dynamic  memory 
representation.  Dynamic  memory  is  Intended  to  augment  standard  memory 
representlons  with  information  about  processing  that  occurred  at  the 
time  of  understanding.  For  example,  if  we  have  a memory 
representation  encoding  the  fact  that  John  hit  Mary,  the  dynamic 
aspect  of  this  information  will  tell  us  exactly  how  we  understood  the 
event  wnen  we  first  heard  about  it.  Was  this  event  unexpected  or  was 
it  consistent  witn  knowledge- based  predictions?  Did  it  contradict 
specific  expectations?  Was  it  overshadowed  by  surrounding  events  of 
greater  significance?  The  answers  to  these  questions  will  determine 
how  we  store  the  fact  tnat  John  hit  Mary  in  memory,  and  thereby  affect 
the  ways  in  which  we  access  this  evert.  We  will  propose  four 
structures  for  dynamic  memory  encoding  and  show  how  tney  can  oe  used 
to  predict  various  recall  behavior  in  both  question  answering  and 
parapnrase  tasks. 

2.  Dynamic  Memory  Structures 

The  four  dynamic  memory  structures  we  will  propose  are  defined  in 
terms  of  knowledge-application  processes  within  a predictive 
understanding  system.  A number  of  computer  programs  have  been 
designed  to  investigate  problems  specific  to  knowledge  structures  and 
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their  application  in  text  understanding  [2,6,7,9,13,27].  We  will 
liiit  ourselves  to  the  icnowledge  structures  developed  by  Hoger  Schanic 
and  Hobert  Abel  son  [24]; 

A GOAL  of  X is  a state  that  X desires.  Once  we  know  that  X 
has  a specific  goal  we  can  sake  predictions  about  what  X 
might  do.  These  predictions  help  us  to  "understand"  and 
interpret  X's  behavior  appropriately.  Some  examples  of 
goals  are  "satisfy-hunger ,"  "preserve-health,"  and 
" acnieve-status ." 

A PLAN  is  a general  strategy  for  attaining  a goal  state. 

Plans  are  Invoked  by  specific  goals.  Goal-oriented  oehavior 
is  frequently  understood  in  terms  of  plans  that  are 
instrumental  to  the  achievement  of  that  goal.  Some  examples 
of  plans  are  "delta-prox"  (change  of  location),  "delta-cont" 
(change  of  possession),  and  "delta-soocont"  (change  of 
social  control). 

A SCHIPT  is  a stereotypic  event  sequence  in  a specific 
situational  context.  Scripts  describe  cultural  conventions 
and  serve  to  connect  events  when  a low-level  causal  analysis 
of  the  situation  might  fail.  Examples  of  scripts  include 
"^restaurant"  (eating  in  a restaurant),  "$telephone" 
(placing/receiving  phone  calls),  and  $gun  (shooting  a gun). 

These  three  knowledge  structures  are  used  predictively,  to  anticipate 
events  that  we  are  liaole  to  hear  about  in  the  context  of  a story. 


Tne  predictive  application  of  these  structures  also  serves  to  provide 
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the  system  with  inferences  (assamptions  that  could  be  wrong)  that  are 
critical  to  overall  comprehension.  For  example,  if  we  are  told,  "Mary 
was  hungry.  Sne  got  into  her  car..."  we  should  predict  that  Mary  is 
going  out  to  either  buy  food  or  to  eat.  This  prediction  relies  on 
goals  (s-hunger),  plans  (d-prox),  and  scripts  (icar,  $store, 
$rest3urant) . If  we  are  then  told,  "She  drove  to  a drive-in,"  we  will 
assume  that  the  "drive-in"  refers  to  a fast  food  restaurant,  not  a 
drive-in  movie.  Tnis  Interpretation  is  prediction-driven,  relying  on 
a Knowledge-based  understanding  of  Mary's  goals  and  behavior. 

If  an  understanding  system  has  access  to  scripts,  plans,  and 
goals,  any  given  input  might  oe  understood  by  script  application  (witn 
a script-based  prediction),  plan  application  (witn  a plan-based 
prediction),  or  goal  analysis  (with  a goal-based  prediction).  At  the 
same  time,  an  event  may  fail  to  be  understood  by  a predictive 
structure,  or  more  importantly,  events  can  contradict  knowledge-based 
predictions.  The  encoding  process  that  preserves  input  information  in 
memory  must  also  tell  us  precisely  which  processes  received  the  input 
information  and  how  that  input  came  to  be  integrated  into  the  story 
representatl Oh . Tnis  process-oriented  part  of  memory  will  be  called 
dynamic  memory,  kithin  tne  context  of  an  understanding  system  that 
exploits  predictive  knowledge  structures,  we  can  define  four  dynamic 


memory  structures: 
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[1]  PREDICTIVE  RESIDUE 

Indicates  that  an  event  was 

1)  Predicted  at  the  time  of  understanding,  and 

2)  Subsequently  substantiated  by  inference  or  explicit 
input 

l2]  attention  transfer  marker 

Indicates  where  attention  shifted  to 

1)  An  unpredicted  event,  or 

2)  A predicted  event  of  inherent  interest 

ii]  EXPECTATIONAL  TRACE 

Preserves  a set  of  expectations  which  were 

1)  Alive  at  one  point  during  understanding,  and 

2)  Subsequently  contradicted  by  explicit  input 

L4j  MEMORY  EXPANSION  MARKER 

Points  to  an  instantiation  kernel  for  a script  expansion 


Each  of  these  structures  indicates  what  distinct  type  of  processing 
occurred  at  the  time  of  understanding  in  order  to  integrate  new  input 
into  tne  story  representation.  Processing  complexity  at  the  time  of 
understanding  affects  the  memory  representation  generated  for  a text. 
A procass-oriented  analysis  of  text  will  therefore  help  us  to  predict 
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various  recall  phenomena  associated  with  question  answering  and 
paraparase  tasks. 


£ach  of  the  four  dynamic  memory  structures  is  expected  to  affect 
text  recall.  The  precise  relationships  between  dynamic  nemory 
structures  and  recall  pnenomena  require  further  investigation;  here 
we  will  outline  a few  of  tne  areas  which  appear  to  be  the  most 
promi si ng . 

3.  Predictive  Residues  and  Question  Answering 

Wnen  people  answer  questions  about  stories,  they  are  able  to 
interpret  those  questions  according  to  the  context  in  whicn  they  are 
asked,  in  other  words,  questions  are  understood  by  processes  that  are 
sensitive  to  the  story  at  hand.  For  example,  consider  the  following 
story: 


Jo.hn  closed  up  nis  office  and  went  to  an  office  party  after 
work  on  Friday.  While  he  was  there,  he  overheard  a 
conversation  between  two  executives  concerning  a special 
account  that  John  had  been  working  on.  From  what  they  were 
saying,  it  became  clear  that  John  was  not  receiving  credit 
for  tne  time  and  energy  he  had  devoted  to  the  project. 
After  nearing  this,  John  felt  extremely  frustrated  and  in  no 
mood  to  socialize.  In  an  effort  to  get  nis  mind  off  his 
trouoles,  John  excused  nimself  and  went  out  to  a movie. 
After  the  movie  he  went  out  and  got  drunk. 


After  reading  this  story,  one  could  be  asked, 


I 
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I 

Q:  Wny  did  John  leave? 

' Typically,  answers  to  this  question  will  explain  that  John  was  upset 

^ or  frustrated  over  work,  that  he  wanted  to  get  away  from  his  joo,  or 

L 

that  he  wanted  to  get  his  mind  off  of  his  problems.  But  whatever  the 
answer,  the  interpretation  of  this  question  requires  an  inference; 

Q:  Wny  did  John  leave  (tne  party)? 

Tne  question  is  inferred  to  be  asking  about  John's  departure  from  tne 
party.  Wnile  tne  words  "left"  or  "leave"  do  not  appear  in  the 
original  story,  we  must  understand  tnat  John  left  his  office,  left  the 
party,  and  left  the  movie.  Yet  only  one  of  these  Is  salient  or 
"Important"  enough  to  be  considered  the  referent  for  our  amoiguous 
question.  Tnis  pnenomenon  is  extremely  problematic  If  we  assume  that 
a question  must  be  understood  (encoded  into  a meaning  representation) 
before  a memory  search  can  oe  conducted. 


In  tne  process  model  of  question  answering  proposed  In  [13].  we 
have  the  following  flow  of  control: 


* ■ 
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EngUsh  question 

I 

I PARSER  I 

T 

conceptual  question 

i 

MEMORY  SEARCH 

answer  key 

RETRIEVAL  HEURISTICS 

conceptual  answer 


GENERATOR 

English  answer 

The  computer  implementation  for  this  process  model  was  Insensitive  to 
context  in  the  sense  that  the  parsing  procedures  were  not  influenced 
by  information  from  the  story  representation.  Questions  were  parsed 
without  any  recourse  to  contextual  factors,  in  much  the  same  way  tnat 
MAR3IE  [22]  parsed  sentences  in  a contextual  vacuum. 

Me  first  acknowledged  a problem  with  this  state  of  affairs  in 
[13]  While  discussing  the  problem  of  focus  assignments  for  questions. 
It  was  observed  that  lexically  identical  questions  can  assume  distinct 
focus  assignments  which  are  dependent  on  story  contexts.  For  example, 


/ 
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consider  the  following  story: 

John  had  Just  bought  a new  car.  He  was  so  happy  with  it 
that  he  drove  it  at  every  possible  opportunity.  So  last 
night  When  he  decided  to  go  out  for  dinner,  he  drove  over  to 
Leone’s.  Wnen  he  got  there  he  had  to  wait  for  a table.... 

After  completing  this  story,  we  can  answer  tne  question: 

Q:  Why  did  John  drive  to  Leone's? 

Answers  fo."  this  question  will  explain  about  Jonn's  new  car  and  his 
desire  to  drive  it.  But  now  suppose  we  are  told  a sligntly  different 
story: 

! 

John  nad  a crusn  on  Mary.  But  ne  was  so  sny  tnat  ne  was 

napoy  to  aerely  oe  in  her  proximity.  So  he  was  in  the  haolt  I 

of  following  her  around  a lot.  He  Knew  that  she  ate  at 

1 

Leone's  very  often.  So  last  night  when  he  decided  to  go  out  ' 

t 

for  dinner,  he  drove  over  to  Leone's.  When  he  got  there  he 

i 

had  to  wait  for  a table....  * 

f 

Now  suDOOSs  we  are  asked  the  identical  question: 

Q:  Uny  did  John  drive  to  Leone's? 

Now  our  answers  will  explain  that  Mary  was  going  to  Leone's  and  John 
wanted  to  be  near  her.  As  these  different  answers  indicate,  our 
conceptual  interpretation  of  this  question  varies  with  each  story. 

Within  tne  context  of  tne  first  story,  the  questl  is  assumed  to  be 
asking  about  John's  method  of  transportation.  Wny  did  ha  driva 
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Instead  of  walk  or  take  a bus  or  use  soae  other  method  of  vehicular 
transportation?  Within  the  context  of  the  second  story,  the  question 
is  assumed  to  be  asking  about  John's  destination.  Why  did  he  go  to 
Leone ' s as  opposed  to  a hamburger  stand  or  some  other  place  to  eat? 

Tne  question  focusses  on  driving  in  the  first  case,  and  Leone's  in  the 
second . 

Intuitively,  we  would  like  to  say  that  the  assignment  of  focus 
for  these  questions  is  part  of  the  understanding  process;  that  is,  we 
understand  these  two  questions  to  be  asking  about  two  different 
tnings.  But  where  does  tne  focus  assignment  come  from?  Tne 
conceptual  focus  for  these  questions  relies  on  information  we  have  in 
memory  about  John's  motives  for  driving  to  Leone's.  If  the  parser  is 
going  to  place  a focus  on  the  conceptual  question  that  it  produces, 
the  parser  must  in  some  way  be  able  to  access  or  resoond  to 
Information  in  the  story  representation. 

Alternatively,  in  a less  intuitive  approacn,  we  can  argue  tnat 
tne  conceptual  question  remains  ambiguous  witn  respect  to  focus  until 
the  story  representation  can  oe  examined  during  the  memory  search.  In 

i 

other  words,  we  cannot  assign  a focus  to  these  questions  until  we  have  i 
searched  memory,  and  found  an  answer  for  the  question.  Tne  answer  I 
then  allows  us  to  construct  a focus  which  is  consistent  witn  that  J 

answer.  If  we  have  information  in  memory  explaining  "drive,"  we  place  { 

j 

tne  focus  on  drive;  if  we  have  Information  explaining  "Leone's,"  we 
focus  on  Leone's.  Any  subjective  sense  of  focus  is  then  established 
as  sort  of  a side  effect  from  the  answer  found  in  memory.  While  this 


possibility  was  not  ruled  out  in  our  earlier  discussions,  we  would  now 
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like  to  argue  against  it  on  tne  grounds  that  it  forces  focus  into  a 
completely  extraneous  position.  Why  generate  a focus  for  the  question 
unless  that  focus  is  in  some  way  useful  in  finding  an  answer?  Why 
would  an  efficient  information  processing  scheme  produce  information 
which  served  no  apparent  purpose?  If  we  can  design  an  alternative 
process  model  which  exploits  focus,  such  an  alternative  must  he  the 
preferred  model.  While  the  process  model  in  [13]  afforded  us  no  such 
alternative  explanation  of  focus  assignment,  we  can  now  argue  for  the 
exploitation  of  focus  by  using  predictive  residues  in  dynamic  memory. 

Predictive  residues  will  enable  us  to  guide  the  process  of 
understanding  so  that  questions  will  be  interpreted  in  a manner  which 
is  sensitive  to  the  context  in  which  they  are  asked.  Whenever  a 
predicted  event  is  substantiated,  that  prediction  is  saved  within  a 
predictive  residue  for  its  corresponding  event.  In  the  course  of 
reading  a story,  a multitude  of  predictive  residues  are  generated, 
each  preserving  a prediction  along  with  its  associated  event  in 
memory.  These  predictions  are  arranged  into  a hierarchical  structure 
at  tne  time  of  understanding,  to  later  compete  for  the  interpretation 
of  questions  about  that  story.  In  our  sample  story,  there  is  a 
prediction  for  each  of  the  three  departures,  but  only  one  of  these 
predictions  involves  high  level  goal  analysis.  John's  goal  of 
recognition  (achieve-status)  is  frustrated  and  we  expect  a new  plan 
(e.g.,  John  decides  to  work  harder),  a goal  substitution  (e.g.,  John 
might  look  for  a new  Job),  or  an  emotional  withdrawal  (e.g.,  John 
sulks).  Leaving  tne  party  qualifies  as  a fora  of  vritndrawal,  and  so 
we  understand  this  departure  in  terms  of  a high  level  goal  analysis. 
Leaving  tne  movie,  on  tne  other  hand,  is  merely  a script-based 


prediction.  Tne  nierarchy  of  predictive  residues  is  constructed  to 
reflect  these  differences,  so  John's  departure  froi  tne  party  la 
ranked  above  leaving  his  office  and  leaving  the  movie.  This  higher 
priority  is  responsiole  for  the  interpretation  of  our  question  as  an 
"obvious"  reference  to  leaving  the  party.  In  this  way,  predictive 
residues  allow  us  to  interpret  technically  ambiguous  questions  in  a 
natural  manner,  within  the  context  of  the  story  in  question. 

Tne  amoiguous  focus  problem  is  also  handled  by  the  appropriate 
predictions  for  a given  context.  In  the  story  about  Jonn's  new  car, 
we  have  a strong  prediction  about  John  driving  his  ear.  In  the  story 
about  John's  infatuation,  we  have  a strong  prediction  about  John  going 
wherever  Mary  goes.  Tne  question  "Wny  did  John  drive  to  Leone's?" 
will  satisfy  either  of  these  predictions  because  it  tells  us  that  John 
was  driving  as  well  as  that  John  went  to  tne  place  where  Mary  was. 
Our  sense  of  focus  in  these  questions  is  a function  of  those 
conceptual  components  in  the  question  which  match  the  predictive 
residue  at  hand. 

In  addition  to  the  Interpretive  advantages  of  predictive 
residues,  there  is  another  extremely  important  advantage  they  provide 
in  terms  of  the  memory  search  needed  to  find  an  answer.  In  QUALM 
[12,13],  all  answers  relied  on  the  identification  of  an  answer  key  in 
memory.  An  answer  key  was  that  conceptual  description  in  tne  story 
representation  that  corresponded  to  the  question's  conceptual  content. 
For  example,  the  question  "Wny  did  John  leave  New  York?"  would  be 
answered  by  first  locating  an  answer  key  in  memory  encoding  the  fact 


that  John  left  New  Yorx. 
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In  order  to  find  answer  keys,  QUALM  conducted  a brute  force 
search  of  the  story  representation  usins  the  question  concept  and  a 
pattern  matcher.  When  a concept  in  memory  was  found  matching  the 
question  concept,  we  had  located  the  answer  key.  This  brute  force 
search  predicts  two  unfortunate  reaction  time  phenomena:  (1)  That 
questions  about  events  occurring  at  the  end  of  a story  will  take 
longer  to  answer  than  questions  about  events  at  the  beginning.  (Tnis 
is  assuming  tnat  the  search  initiates  at  the  oeglnning  of  the  story 
representation).  (2)  Tne  longer  the  story,  the  longer  it  will  take  to 
answer  questions  about  events  near  the  end.  Neither  of  these 
predictions  seem  right,  but  they  are  nevertheless  unavoidable  if  a 
brute-force  pattern-matching  memory  search  is  conducted.  An  indexing 
scheme  could  lessen  the  effect  (from  a linear  response  to  a 
logarithmic  response)  but  the  effect  would  still  exist. 

Here  we  see  another  important  ramification  of  predictive 
residues.  If  a question  is  interpreted  by  means  of  a predictive 
residue,  we  can  transcend  the  entire  problem  of  a memory  search  by 
merely  exploiting  a link  from  the  residue  to  its  corresponding  data 
entry  in  the  standard  story  representation.  Tnis  link  is  trivial  to 
generate  at  the  time  of  understanding,  since  a substantiated 
expectation  builds  its  data  entry  at  the  time  it  is  satisfied.  We 
need  only  estaolish  a pointer  from  that  expectation  to  its  data  entry 
in  tne  standard  story  representation.  Given  such  a link,  we  can 
automatically  locate  the  answer  key  without  any  search  wnatsoever. 
Answer  keys  are  then  found  in  constant  time  after  question 
Interpretation.  In  other  words,  it  takes  no  longer  to  find  the  answer 
key  in  memory  tnan  it  does  to  produce  a conceptual  interpretation  of 
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tne  question. 


Tne  identification  of  appropriate  answer  keys  becoaes  even  nore 
problematic  when  we  rely  on  an  answer  key  for  more  complex  question 
answering  behavior.  For  example,  in  the  SAM  system,  we  implemented  a 
heuristic  that  would  provide  elaborations  in  the  event  that  a 
verification  question  (yes  or  no  question)  were  answered  negatively. 
For  example,  if  SAM  were  asked  "Did  the  waitress  give  John  a menu?"  it 
could  return  "No,  tne  hostess  gave  John  a menu."  But  this  elaboration 
must  oe  derived  from  a partial  match  to  the  question  concept.  Tnat 
is,  an  answer  key  must  be  found  in  the  story  representation  which 
corresponds  closely,  but  not  exactly  to  the  question  concept.  In  this 
case,  tne  correspondence  breaks  down  with  the  slot  fillers  in  the 
"actor"  and  "from"  slots: 


QJESTION  CONCEPT: 


JOHN 


WAITRESS  40^  ATRANS  4-  MENU  H 


I— < WAITRESS 


DESIRED  ANSWER  KEi: 


HOSTESS  ^ ATRANS  4>  MENU 


JOHN 


HOSTESS 


But  exactly  how  do  we  know  to  let  the  actor  and  from  slot  fillers 
vary?  If  we  allow  partial  matches  with  other  slots,  we  will  get 


different  elaborations: 
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ALT&RNATIVE  ANSwtS  iCEY: 


r-*  JOHM 


WAITRESS  ^ ATRANS  ^ CHECK  ^ 


1— < WAITRESS 


If  we  allow  for  a variation  in  the  object  slot  filler,  we  would 
get  "No,  the  waitress  gave  John  a check."  While  this  is  a technically 
correct  response,  it  is  sonenow  less  appropriate  than  a response  wnich 
tells  us  wno  gave  John  a -nenu.  In  the  SAM  syste^B  a script-based  focus 
heuristic  was  Inpleaented  to  handle  tne  proble.ii  of  partial  pattern 
aatcnes  for  answer  elaborations.  Tnis  heuristic  relied  on  the  notion 
of  "constant"  events  in  a script  and  "variable"  coaponents  within 
those  events.  So,  for  exaaple,  a script  constant  in  tne  restaurant 
script  descrloes  the  patron  receiving  a aenu.  Wnere  he  gets  it  is  a 
variable;  it  might  come  from  a waiter,  waitress,  hostess,  maitre  d’ , 
or  he  aay  pick  it  up  off  tne  taole  himself.  The  search  for  an  answer 
key  in  these  cases  aust  then  be  guided  by  the  script  constants  and 
variables. 


While  this  strategy  sufficed  for  tne  script-based  texts  processed 
by  SAM,  it  did  not  nave  an  immediate  analogue  in  domains  dependent  on 
plans  and  goals.  For  exaaple,  suppose  we  had  read: 

A small  twin  engine  airplane  carrying  federal  marshals  and  a 
convicted  aurderer  wno  was  being  transported  to  Leavenworth 
crashed  during  an  emergency  landing  at  O' Hare  Airport 
yesterday.  During  rescue  operations,  the  murderer  was  able 
to  grao  a gun  from  a wounded  marshal  and  effect  an  escape  in 
a fire  department  vehicle. 
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In  the  context  of  this  story  it  would  oe  reasonable  to  ask: 


Q:  Did  the  murderer  get  a knl fe? 


To  which  we  would  like  to  respond: 


A:  No,  the  murderer  got  a gun. 


Again  we  have  the  problem  of  a partial  pattern  match,  where  the  wrong 
match  will  produce  an  innappropriate  elaboration. 


QUfiSTION  CONCEPT: 


MUHOEfiER  ATRANS  KNIFE 


DESIRED  ANSWER  KEY: 


MURDERER  ^ ATRANS  GUN 


MURDERER 


UNSPSC 


MURDERER 


UNSPEC 


ALTERNATIVE  ANSWER  KEY: 


MURDERER  ATRANS  ♦-  VEHICLE  H 


MURDERER 


UNSPEC 


Here  we  see  that  it  is  no  longer  enough  to  constrain  the  partial  match 
in  terms  of  slots  alone;  we  now  appear  to  need  constraints  on  the 
slot  fillers  as  well.  In  this  case  we  are  looking  for  an  ATRANS  of  a 
weapon.  But  wnere  do  these  constraints  come  from?  Wnat  we  really 
need  here  is  knowledge  about  the  murderer's  general  plan  to  procure  a 
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weapon.  Suon  an  expectation  is  generated  at  the  time  of 
understanding,  distinct  from  another  expectation  about  procuring  a 
vehicle.  If  predictive  residues  can  be  accessed  to  aid  in  the 
understanding  of  the  question,  then  this  question  will  be  picked  up  by 
tne  residue  involving  a weapon. 

In  exploiting  predictive  residues  for  memory  searches,  we  see  how 
the  intuitive  distinction  between  interpretation  and  memory  retrieval 
becomes  somewhat  blurred.  Predictive  residues  are  primarily  an 
interpretive  mechanism.  But  once  a residue-driven  Interpretation  has 
oeen  produced,  the  responsible  residue  can  be  further  exploited  to 
show  us  precisely  where  in  the  story  representation  we  must  look  to 
find  the  answer.  This  technique  allows  us  to  virtually  parse  "into 
the  answer  key"  as  well  as  into  a conceptual  representation  for  the 
question.  Predictive  residues  therefore  augment  standard  story 
representations  witn  a ” top-down  component  that  guides  the 
interpretation  of  questions  into  that  story  representation.  The 
parsing  of  questions  can  then  be  followed  directly  witn  procedures  for 
finding  an  answer;  no  intermediate  search  is  needed  in  order  to  tie 
the  question  in  with  the  story. 

Predictive  residues  are  therefore  utilized  for  the  task  of 
question  answering  in  two  ways:  as  an  interpretive  device  and  as  an 
alternative  to  massive  memory  searches.  Of  the  four  dynamic  memory 
structures,  predictive  residues  are  most  useful  for  the  task  of 
question  answering.  Tne  remaining  three  dynamic  memory  structures  are 
used  in  the  tasK  of  paraphrase  rather  than  question  answering.  But 
before  describing  these,  we  will  first  motivate  our  discussion  by 


j 


1 
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presenting  a sample  narrative  along  with  a simplified  version  of  its 
memory  representation. 


U.  "Tne  War  of  the  Gnosts" 


In  order  to  illustrate  our  three  remaining  dynamic  memory 
structures  we  will  consider  a frequently  referenced  narrative  that 
Frederic  Bartlett  first  discussed  in  his  early  work  on  human  memory 
[1].  "The  War  of  the  Gnosts"  is  an  Eskimo  folk  tale  which  Bartlett 
used  to  test  free  recall.  Subjects  were  asked  to  read  the  story  and 
then  produce  a paraphrase  of  it.  His  discussion  of  his  experiments  is 
particularly  useful  for  our  purposes  because  he  included  a number  of 
sample  paraphrases  taken  at  various  times  after  tne  initial  reading. 
We  will  periodically  reference  these  results  in  tne  discussion  to 
follow.  But  first,  the  story  itself: 


The  War  of  the  Gnosts 


One  night  two  young  men  from  Egulac  went  down  to  the 
river  to  hunt  seals,  and  while  they  were  there  it  became 
foggy  and  calm.  Tnen  they  heard  war-cries,  and  they 
thought:  "Maybe  this  is  a war-party".  They  escaped  to  the 

snore,  and  hid  behind  a log.  Now  canoes  came  up,  and  they 
neard  the  noise  of  paadles,  and  saw  one  canoe  coming  up  to 
tnem.  There  were  five  men  in  the  canoe,  and  they  said: 

"What  do  you  think?  We  wisn  to  take  you  along.  We  are 
going  up  the  river  to  make  war  on  the  people". 

One  of  tne  young  men  said:  "I  have  no  arrows". 

"Arrows  are  in  the  canoe",  they  said. 

"I  will  not  go  along.  1 might  be  killed.  My  relatives 
do  not  know  where  I nave  gone.  But  you",  he  said,  turning 
to  the  other,  "may  go  with  them." 

So  one  of  the  young  men  went,  but  the  other  returned 


nome. 
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And  the  warriors  went  on  up  the  river  to  a town  on  the 
other  side  of  Kalana.  The  people  came  down  to  the  water, 
and  they  began  to  fight,  and  many  were  killed.  But 
presently  the  young  man  heard  one  of  the  warriors  say: 
"Quick,  let  us  go  home:  that  Indian  has  been  hit".  Now  he 
thought:  "On,  they  are  ghosts".  He  did  not  feel  sick,  but 
they  said  he  had  been  shot . 

So  the  canoes  went  back  to  Egulac,  and  the  young  man 
went  ashore  to  his  house,  and  made  a fire.  And  he  told 
everybody  and  said:  "Behold  1 accompanied  the  ghosts,  and 
we  went  to  fight.  Many  of  our  fellows  were  killed,  and  many 
of  those  who  attacked  us  were  killed.  They  said  1 was  hit, 
and  I did  not  feel  sick". 

He  told  it  all,  and  then  he  became  quiet.  Wnen  the  sun 
rose  he  fell  down.  Something  black  came  out  of  his  mouth. 
His  face  became  contorted.  The  people  jumped  up  and  cried. 

He  was  dead. 


Using  techniques  of  predictive  understanding,  an  understanding  system 
would  internally  represent  this  story  on  four  representational  levels: 
the  story  includes  (1)  scripts,  (2)  plans,  (3)  goals,  and  (4)  specific 
events  linking  tnese  larger  structures.  We  will  not  attempt  to 
present  a complete  story  representation  here,  but  we  will  look  at  a 
somewhat  simplified  version  wnich  will  suffice  for  our  purposes.  In 
particular,  we  will  not  try  to  represent  anything  connected  with  the 
problematic  presence  of  ghosts. 
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MiWI;  script  = $hunt 

nunters  : 2 men  (hereafter  referred  to  as 
animal  s seal 

path  s default  with  ATM1  interupt 

ATrt1:  nunters  <s>  ATTEND  <-  ears  (to)  MOBJ:  war  cries 
Initiate/Reason 
Kai42;  script  s $war 

attackees  * Ml, M2 
Initiate 

P>Healtn  goal  (Goall)  on  part  of  Ml,  M2 
Reason 

Ml, M2  <=>  PTRANS  <-  Ml ,M2  (to)  behind-log 
(Plani  in  response  to  Goall) 

MErt2:  canoe  <s>  PTRANS  <-  canoe  (to)  Ml, M2 
enable 

conversation  between  warriors  _M1,M2: 


Tnis  story  representation  is  lacking  many  details  included  in  tne 
original  narrative.  These  omissions  are  not  intended  to  reflect 
assumptions  we  would  like  to  make  about  which  information  is 
rememoered  or  forgotten.  He  merely  wanted  to  present  a somewhat 
simplified  version  of  the  story  representation  in  order  to  Illustrate 
various  aspects  of  dynamic  memory  structures. 


rfEMI  represents  an  instantiation  of  the  hunting  script 

which  specifies  a typical  nunt  with  Ml  and  M2  acting  as  hunters 
and  seals  acting  as  their  prey.  This  otherwise  uneventful 
episode  is  interrupted  by  ATrtl. 

ATM1  describes  the  hunters  hearing  war  cries.  Tnis 

event  initiates  a reasoning  process  by  Ml  and  M2  which  leads  thea 
to  conclude  that  they  are  part  of  a new  scriptal  situation: 
M£M2. 

McM2  represents  an  instantiation  of  the  war  script 

which  specifies  only  that  M1  and  M2  are  being  attackd  by  unknown 
assailants . 

Tne  realization  of  MEM2  initiates  a new  goal  for  Ml  and  M2  which 
specifies  the  preservation  of  their  (good)  health  states.  Tnis 
goal  iaplicitly  suggests  that  their  health  states  are  being 
threatened:  M1  and  M2  are  in  danger. 

The  health  goal  explains  why  Ml  and  M2  nide  behind  a log.  This 
transfer  of  location  is  part  of  a plan  instrumental  to  health 
preservation. 

MEM2  resumes  with  the  arrival  of  a canoe  filled  with 
warriors. 


Tne  arrival  of  tne  canoe  enables  a conversation. 
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conversation  between  warriors  & Ml, M2: 


W's:  express  desire  for  Ml, M2  Goal2:  M1,M2  Join  fattackers  P1 

to  Join  attackers  in  $war  Plan2:  Infora/Reason  planbox 

Ml:  explain  aissing  enablement  Goal3:  Foil  Goal2  P2 

(no  arrows)  Plan3:  Inform/Reason 

W's:  explain  enablement  OK  Goal4:  Thwart  Plan3  P3 

(arrows  in  canoe)  Plan4:  Inform/Reason 

Ml:  explicit  refusal  Goal3:  Foil  Goal2  P4 

"relatives  don't  know..."  Plan5:  Inform/Reason 

offer  M2  instead 


///////////////////////////////////////////////////// 


/ Goal  Fate  Graph:  / 

/ / 

/ PI  P2  P3  P4  / 

/ / 

/ Goal1  > S / 

/ Goal2  > S / 

/ Goal3  > TF > S / 

/ Goal4  > S / 

/ / 

/ S = success  TF  s temporary  failure  / 

/ / 

/ The  success  of  Goall  is  only  success  for  M1.  / 

/ / 

/ If  we  examine  the  fate  of  the  competing  goals  / 

/ Goall  and  Goal2,  we  see  that  a compromise  / 

/ was  reached  satisfying  both  parties.  / 

/ / 


///////////////////////////////////////////////////// 


r 
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Tne  conversation  oetween  M1  and  the  warriors  can  be  analyzed  in  terns 
of  conflicting  goals  and  their  corresponding  plans: 

GOAL!  (preserve  health)  is  the  top-level  goal  of  Ml 

G0AL2  is  the  warriors'  top-level  goal  of  getting  Ml  and  M2  to 

join  tne.n  in  the  aggressor  role  of  the  war  script.  To  achieve 
this  goal  they  employ  a simple  in form- reason  plan  of  expressing 
their  desire. 

GOALS  is  a suogoal  of  G0AL1  which  opposes  the  achievement  of  G0AL2. 

GOALA  is  a suogoal  of  G0AL2  wnich  opposes  the  achievement  of  GOALS. 

Wnen  GOALA  succeeds,  GOALS  temporarily  falls.  PLANS  is  then 
replaced  oy  'PLANS  which  offers  a compromise  designed  to  satisfy 
GOAi.2  in  part . 

Acceptance  of  the  compromise  signals  the  achievement  of  GOALS  and 
its  parent  G0AL1,  along  with  the  warrior's  top  level  G0AL2. 
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MEi/il:  $nunt  ends  wttn 

Ml  <s>  PlfiANS  Ml  (to)  nooe,  and 
M2  Joins  attadkers  In  $war 
M£i42:  (cont.  of  |war) 

attadkers  <=>  PTRANS  <-  attackers  (to)  town 
Jfighting 

$death  (multiple  instandes) 

ATM2:  $‘iit  with  M2  = victim 

Initiate/Reason 
warrior  <s>  SPiiAK 
^ Initiate 

AT/S:  M2  <=>  MBUILD  <-  [ghosts?] 

£11:  ATM2  does  NOT  result  in  pain  for  Ml 

MEM2:  $war  ends  with 

attackers  <=>  PTRAN3  attackers  (to)  home 
^11“  enable 

M£Mi:  $build-fire  with  actor  s M2 

gravity  <=>  PROPEL  <-  M2  (to)  ground 
ATMM:  force  <=>  PROPEL  <-  black  (from)  mouth  of  M2 
pnysstate  M2  becomes  -10 

Initiate/ Reason 
people  <s>  SPEAK 


becomes 

PR 


At  tnis  point  we  are  told  that  Mi  goes  hooe  and  M2  Joins  the 
war  party,  from  which  we  must  conclude  that  $hunt  is  no  longer 
an  active  script. 

MSM2:  With  M2  added  to  the  war  party,  the  |war  script  Is  now  continued 
when  the  attacking  party  arrives  at  a town  across  from  Kalama. 

Subscripts  within  $war  refer  to  fighting  and  deaths. 

ATM2:  In  particular,  M2  is  hit  by  an  arrow.  This  is  worthy  of 

attention  because  it  threatens  the  life  of  a main  character. 
Expectations  are  generated  at  this  point  about  M2's  health 

state. 


M2  getting  hit  motivates  the  warrior's  observation. 

ATM3:  Tne  warrior's  ooservation  leads  M2  to  conclude  something  about 
gnosts.  Tnis  conclusion  is  worthy  of  attention  because  it  makes 
no 

sense  and  it  involves  ghosts  which  are  inherently  interesting. 

ET1:  Tne  expectations  generated  at  ATrt2  are  explicitly  contradicted. 

MEM2:  Tne  war  party  returns  hose  from  which  we  must  conclude  that  the 
$war  script  is  no  longer  active. 

nSA'i:  a new  script  $bulld-fire  is  instantiated  with  a default  path 
specification  and  a role  binding  for  M2. 

M2  tells  his  story  to  the  villagers. 

M2  falls  down. 

ATMU:  Sometning  black  (???)  comes  out  of  M2's  mouth. 

M2  dies.  At  this  point  ET1  becomes  a predictive  residue. 


Tne  villagers  react. 
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5.  Attention  Transfer  Markers  and  Free  Recall 

Tne  notion  of  an  attention  shift  Is  critical  for  the  Integration 
and  subsequent  retention  of  Information  In  memory.  Consider  the 
following  excerpt  from  the  "The  War  of  the  Gnosts": 

"...When  the  sun  rose  he  fell  down.  Something  black  came 

out  of  his  mouth.  His  face  became  contorted.  The  people 

jumped  up  and  cried.  He  was  dead." 

In  all  of  the  paraphrases  for  this  story  that  Bartlett  published  [1], 
subjects  mentioned  black  coming  out  of  his  mouth.  This  event  is 
memorable  because  it  is  so  unexpected  and  Inexplicable.  If  we  had 

been  told  that  blood  came  out  of  his  moutn,  we  would  expect  less 

recall  for  this  event  since  It  can  be  understood  in  terms  of  common 
knowledge  about  violent  deaths.  Tne  fact  that  it  was  something  black 
that  came  out  of  his  mouth  Is  very  close  to  making  sense  but  it  does 
not  quite  fit  (can  blood  be  black?);  this  serves  to  enhance  its 
chances  of  being  retained  and  subsequently  reproduced  in  free  recall. 

Attention  transfer  markers  are  designed  to  reflect  the  processing 
nii-tory  for  input  information  in  a way  which  effectively  tells  us 
whether  or  not  we  nave  striking  information. 

While  it  is  not  clear  exactly  what  should  be  Included  in  an  ATM, 
we  can  expect  that  attention  transfer  markers  will  be  given  weights 

relative  to  the  surrounding  context.  These  relative  weights  will  v 

1 

reflect  the  %iays  that  wnat  is  significant  or  interesting  in  one  story  i 

I 

may  be  rountine  or  less  deserving  of  attention  in  another.  For  f 

example,  if  a variation  on  "The  War  of  the  Ghosts"  were  to  end  with: 

I 
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..Wnen  tne  sun  rose  he  fell  down.  Something  blaok  cane  out 
of  his  aoubn.  His  face  became  contorted.  A great  snake 
materialized  over  his  body.  Tne  snake  sang  an  eerie  song 
and  vanished  in  the  air.  The  people  jumped  up  and  cried. 

He  was  dead." 

it  is  likely  that  the  singing  snake  will  overpower  everything  else  at 
this  point  in  the  story  representation.  We  could  expect  subjects  to 
remember  the  snake,  and  perhaps  do  so  at  the  expense  of  forgetting  the 
black  expulsion.  If  too  many  interesting  or  bizarre  things  nappen, 
some  will  be  designated  as  lesser  events  in  order  to  focus  attention 
on  a smaller  number  of  more  demanding  events.  We  expect  there  la  an 
upper  oound  on  the  ratio  of  total  attention  strengths  to  input 
processed  (TAS/IP  ratio)  tnat  cannot  be  surpassed  in  the  course  of 
constructing  a story  representation.  Processing  resources  are  finite, 
and  tne  amount  of  processing  tnat  can  be  devoted  to  problematic  input 
is  limited  by  the  resources  available  l3].  So  if  the  TAS/IP  ratio  is 
exceeded,  attention  transfer  marker  strengths  must  be  devalued 
appropriately.  An  "ATM  overload"  phenomenon  can  be  expected  to  occur 
when  there  are  too  many  ATM's.  Under  these  conditions  we  can  expect 
free  recall  to  suffer  from  a number  of  omissions.  For  example,  anyone 
reading  tne  following  story  would  probably  suffer  from  an  ATM 
overload: 

John  was  walking  down  the  street  eating  an  ice  cream  cone, 
he  saw  a man  walk  Into  the  bushes  and  begin  to  undress. 

Soon  a crowd  had  gathered  and  the  police  came  to 
investigate.  While  they  were  there  a giant  explosion 
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occurred  two  clocks  away.  People  came  running  in  their 
direction  screaming  tnat  there  had  oeen  a terrible  accident. 

Many  were  bleeding  and  one  man  had  lost  an  arm.  Meanwhile  a 
fire  oroke  out  in  the  park.  People  said  there  was  a 
conspiracy  a foot  because  a bomb  had  been  sighted  nearby 
only  yesterday.  When  an  epidemic  broke  out  the  following 
week,  everyone  knew  tne  aliens  had  landed. 

A boring  story  is  one  for  which  tne  TAS/IP  ratio  fails  to  exceed  some 
minimal  threshold.  Stories  of  the  sort  understood  by  SAM  [9]  which 
are  entirely  script-based  fall  into  tnis  category.  Optimal  retention 
will  oresumaoly  occur  when  the  TAS/IP  ratio  rests  within  some 
preferred  Interval. 

There  may  oe  a number  of  secondary  memory  effects  associated  with 
ATM's  and  input  info."matlon  surrounding  them.  For  example,  there  may 
be  a retroactive  Inhibition  effect  on  those  concepts  immediately 
preceeding  an  ATM.  Tnis  would  parallel  an  effect  that  occurs  in  list 
learning  experiments  where  a "surprising"  or  "unexpected"  list  element 
will  Interfere  with  the  retention  of  list  elements  immediately 
preceding  that  element.  Of  course,  in  the  task  of  text  comprehension, 
we  Should  expect  a number  of  factors  to  contribute  to  the  reliability 
any  sucn  phenomenon.  In  particular,  we  must  assume  that  the 
conceptual  content  of  information  preceding  an  ATM  will  play  a major 
role  In  wnetner  or  not  that  Information  will  be  lost  in  a free  recall 
account  of  the  story.  Information  that  is  necessary  for  a critical 
causal  connection  should  be  less  expendable  than  Information  with  no 


ausal  implications. 
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In  tens  of  paraphrase  behavior,  we  expect  all  ATM's  to  be 
included  In  free  recall  accounts  for  a story.  To  see  how  this 
prediction  fares  in  Bartlett's  study,  we  check  for  references  to  the 
four  ATM's  In  "The  War  of  the  Ghosts"  in  ten  paraphrases  Bartlett 
provided.  The  results  indicate  that  our  ATM's  do  tend  to  be  preserved 
in  paraphrases,  although  sone  are  more  prevallent  than  others: 

ATM1  (Mfi-ll  interrupt) 

ATM2  (M2  is  oit) 

ATM3  (H3UILD  "ghosts") 

ATM4  (black  fron  moutn) 

In  our  dynauic  aemory  aodel , we  would  like  to  generate  weights 
for  ATM's  that  predict  the  probability  of  their  free  recall. 
According  to  tnese  results,  ATM2  and  ATMH  are  the  strongest  ATMs  while 
ATM!  and  ATM3  are  the  weakest.  Tne  two  weakest  ATM's  nere  (ATM1  and 
ATM3)  are  interesting  because  there  are  additional  factors  affecting 
our  aeaory  representation  at  these  points.  In  every  case  where  ATM1 
is  ouniitted,  it  was  also  the  case  that  the  entire  script  (M3M1)  was 
also  oinltted  froa  recall.  Whenever  MaMI  was  present  in  a paraphrase, 
ATM1  was  also  present.  Since  a script  interruption  cannot  oe  recalled 
without  referencing  that  script,  this  result  is  not  surprising.  If  we 
had  Identified  ATM1  more  generally  as  aerely  a script  interruption 
(for  any  introductory  script  at  the  beginning  of  the  story)  then  ATM1 

would  have  occurred  in  3 of  the  10  paraphrases. 

i 

The  contrast  between  ATM3  and  ATM4  Is  of  special  interest  because 
they  both  fall  into  the  category  of  inexplicable  events.  Yet  ATM3  was 

included  in  only  6 of  the  10  paraphrases  while  ATMU  was  included  in 

i 

i 

I 

i 
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.9 

.6 
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all  10.  One  possible  explaination  derives  from  the  fact  that  ATM4 
describes  a concrete  event  that  can  be  visualized,  while  ATM3 
describes  a cognitive  event  which  does  not  yield  a graphic  image. 
Further  evidence  for  this  explaination  can  be  found  in  the  fact  that 
ghosts  (which  can  be  visualized)  are  mentioned  in  some  way  in  9 of  the 
10  paraphrases.  We  might  therefore  conclude  that  graphic  concepts 
snould  receive  heavier  ATi^  weightings  than  abstract  concepts. 

We  expect  two  major  factors  to  influence  the  weight  of  an  ATM: 
(1)  shifts  in  the  applicability  of  various  knowledge  structures,  along 
with  (2)  sensitivity  to  the  notion  of  "inherent  interest."  Significant 
factors  of  the  first  kind  include  script  triggerings,  script 
interference  points,  script  interruptions,  goal  activation,  plan 
activation,  role  theme  activation,  goal  frustration,  and  goal 
conflicts.  Factors  of  the  second  sort  will  Involve  a taxonomy  of 
interesting  events  whicn  must  specify  instances  of  violence,  sexual 
activity,  and  various  attributes  that  violate  normative  expectations 
(great  beauty,  excessive  wealth,  etc.)  A theory  of  inherent  interest 
tnerefore  enters  into  the  system  at  this  point. 

6.  fixpectatlonal  Traces  and  Memory  Retention 

Predictive  understanding  systems  naturally  generate  a number  of 
expectations  that  are  not  explicitly  substantiated  by  subsequent  text. 
Some  of  these  expectations  form  the  basis  for  Inferences,  while  others 
are  discarded  as  "dead  ends."  Expectations  which  fall  to  materialize 
or  wnich  are  contradicted  by  subsequent  input  become  expectations! 
traces  in  dynamic  memory.  Expectations!  traces  therefore  encode 
Information  about  what  could  have  happened  if  the  story  had  taken  a 
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slightly  different  turn.  These  tra^e  structures  are  necessary  for 
both  answering  questions  and  producing  paraphrases. 

The  class  of  "expectational"  questions  query  the  understander 
about  events  that  did  not  occur.  [12,13]  "Why  didn't  John  stay  at  the 
party?"  asks  about  an  event  which  is  in  opposition  to  wnat  happened: 
John  left  the  party  early.  In  order  to  answer  this,  an  understander 
must  have  nad  an  expectation  about  John  staying  at  the  party.  This 
expectation  was  converted  into  a trace  as  soon  as  we  heard  that  John 
left  early.  We  can  tnen  search  our  expectational  traces  for  the  event 
in  question,  and  follow  the  matching  trace  back  to  the  event  or  events 
in  the  story  representation  that  were  responsiole  for  the  failed 
expectation. 

One  version  of  this  retrieval  technique  was  implemented  in  the 
SAM  system  [9,12,13]  wnere  an  expectational  trace  was  called  a "ghost 
path."  Snost  paths  in  SAM  were  entirely  script-based,  but  in 
principle,  traces  can  be  derived  from  any  predictive  structure.  In 
addition  to  tneir  utility  for  expectational  questions,  expectational 
traces  will  be  important  in  free  recall  as  well. 

Sometimes  an  expectational  trace  is  "strong"  enough  or  disturbing 
enougn  to  warrant  special  status.  Leaving  a party  early  is  not 
terribly  disturbing,  but  other  expectational  traces  should  be 
generated  witn  a certain  reluctance.  For  example,  in  "The  War  of  the 
Ghosts"  we  are  told  that  the  main  character  gets  hit  by  an  arrow,  yet 
he  feels  no  pain.  Wnen  we  are  told  that  he  was  hit,  we  generate  an 
expectation  that  tne  victim  will  undergo  a negative  physical  state 
Change,  possibly  resulting  in  death.  But  subsequent  text  explicitly 
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contradiots  this  expectation,  giving  us  an  expectational  trace.  Tne 
necessary  result-causality  within  this  particular  prediction  aakes  the 
trace  extresely  salient.  It  should  be  impossible  for  someone  to  be 
hit  and  not  feel  anything.  This  salience  should  result  in  a strong 
recall  probability.  In  fact,  of  the  ten  paraphrases  for  this  story 
that  Bartlett  published  [1],  eight  subjects  mentioned  the  fact  that  no 
pain  was  felt. 

Expectational  traces  can  be  derived  from  a variety  of  Knowledge 
structures.  Tne  ghost  paths  in  SAM  were  all  expectational  traces 
derived  from  scrlptal  expectations.  We  can  also  expect  to  find  traces 
resulting  from  goals,  plans,  and  role  themes.  For  example,  consider 
tne  following  story  adapted  from  a newspaper  account: 

A small  twin  engine  airplane  carrying  federal  marshals  and  a 
convicted  murderer  who  was  being  transported  to  Leavenworth 
crasned  during  an  emergency  landing  at  O' Hare  Airport 
yesterday.  During  rescue  operations,  the  murderer  was  able 
to  grab  a gun  from  a wounded  marshal  and  effect  an  escape  in 
a fire  department  vehicle. 

In  this  story  there  is  a script-based  trace  concerning  the  flight  of 
the  airplane:  our  airplane  script  had  predicted  a safe  and  uneventful 
Journey.  But  consider  a slight  variation  on  this  story: 

A small  twin  engine  airplane  carrying  federal  marshals  and  a 
convicted  murderer  who  was  being  transported  to  Leavenworth 
crashed  during  an  emergency  landing  at  O' Hare  Airport 
yesterday.  During  rescue  operations,  the  murderer  was  able 
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to  grab  a gun  fron  a wounded  aarshal  and  effect  an  escape  in 

a fire  department  veniole. 

In  this  story  we  have  a new  expeotational  trace  which  derives  from 
goal-oriented  predictions.  The  marshal  should  have  never  given  the 
murderer  his  gun.  On  the  contrary,  his  role  theme  dictates  that  he 
will  try  to  maintain  control  over  the  murderer's  movements.  Tne 
marshal's  goals  should  be  in  conflict  with  the  murderer's.  Given  a 
story  such  as  this  where  tne  marshal  acts  "out  of  character"  we  are 
forced  to  generate  an  expectatlonal  trace  concerning  the  marshal's 
goals. 

A taxonomy  of  traces  is  needed  to  determine  when  a trace  is 
strong  enough  to  warrant  retrieval  in  free  recall.  Necessary 
causality  is  probably  the  strongest  condition  for  recall.  But  it  is 
not  clear  whether  useful  priorities  can  be  defined  in  terms  of  purely 
structural  factors.  Will  certain  script-based  traces  tend  to  be 
stronger  or  weaker  than  plan-based  traces?  What  are  the  conditions 
for  relative  strength  evaluations  in  expeotational  traces?  Are  the 
conditions  purely  causal,  or  inherently  determined  by  specific  content 
alone?  Tnese  are  some  of  the  more  compelling  issues  surrounding 
expectatlonal  traces. 

7.  Memory  expansion  Markers  and  Recall  Errors 

Errors  in  recall  are  often  classified  into  omissions,  additions, 
and  transpositions.  If  we  limit  ourselves  to  those  errors  that  omit, 
add,  or  transfigure  script-based  information,  we  can  formulate  these 
errors  in  terms  of  memory  expansion  markers.  Memory  expansion  markers 
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point  to  instantiation  kernels  bnat  encode  all  essential  information 
necessary  for  a complete  reconstruction  of  a script  instantiation. 
For  example,  suppose  we  hear  that  John  went  to  a restaurant,  ordered  a 
steak,  was  served  by  a pretty  waitress,  and  he  left  a large  tip.  This 
episode  will  be  represented  by  an  instantiation  kernel  containing 
three  types  of  information:  (1)  a script  name,  (2)  a route  through 
the  script,  and  (3)  specific  role  bindings.  In  this  ease  we  would 
have: 

script  = $restaurant 
route  : default  path 

bindings  = (patron  . G1)  (meal  . G2)  (waiter/waitress  . G3) 


where  G1,  G2,  and  33  point  to  memory  tokens  for  John,  a hamburger,  and 
a pretty  nameless  female,  respectively.  If  we  were  asked  whether  or 
not  John  paid  a check,  we  would  have  to  expand  this  kernel  Into  a 
complete  causal  chain  representation  of  the  sort  that  the  SAM  system 
utilized  [9]  in  order  to  determine  that  the  default  path  of  the 
restaurant  script  does,  in  fact,  include  the  patron  paying  his  check. 


Many  recall  errors  Involve  scriptal  Information  and  can  be 
Investigated  in  terms  of  instantiation  kernels  and  their  expansion. 


This  particular  form  of  dynamic  memory  appears  to  suffer  greatly  as 


the  interval  of  retention  grows.  For  example,  in  "The  War  of  the 
Gnosts"  there  Is  an  initial  description  of  two  young  men  setting  out 
to  hunt  seals.  In  two  of  ten  paraphrases  the  seals  are  transformea 
into  fish,  and  in  three  of  the  ten  there  is  no  reference  to  a hunting 
expedition  in  any  form.  These  accounts  suggest  that  there  are  some 
standard  kernel  expansion  problems  that  frequently  arise  and  result  in 
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menory  omissions  or  transpositions  of  information. 

Initially  we  expect  that  all  subjects  encode  a memory  expansion 
marker  with  the  proper  script  name  and  role  bindings.  In  this  case  we 
have  a hunting  script  with  two  men  bound  to  the  role  of  the  hunter, 
and  seals  bound  to  the  role  of  prey.  Early  memory  degradation  occurs 
when  "weak"  role  bindings  disintegrate.  The  transposition  of  fish  for 
seals  can  be  accounted  for  in  this  manner.  Seals  have  a weaker  role 
binding  than  the  two  young  men  because  they  do  not  appear  again  in  the 
story;  the  two  young  men  are  main  characters.  The  binding  for  prey 
in  the  hunting  script  is  therefore  very  weak  and  may  be  lost.  Wnen 
this  occurs,  and  the  understander  attempts  to  reconstruct  the  scriptal 
situation,  fish  must  be  supplied  by  an  override  from  associative 
memory.  Intuitively,  we  expect  seal  hunting  to  be  strongly  linked  to 
Eskimos,  but  we  also  expect  Eskimos  to  fish  frequently.  Therefore 
fish  can  be  reconstructed  for  the  hunting  episode  if  we  know  the 
hunters  are  Eskimos.  To  determine  the  precise  mechanism  for  this  is  a 
challanging  problem  since  it  requires  a strong  theory  of  associative 
memory  structures. 

A later  stage  of  memory  degradation  involves  losing  an  entire 
script  that  appeared  in  the  story.  Possible  script  omission  is 
determined  by  a script's  causal  connectivity  within  the  larger  story 
context:  scriptal  episodes  that  are  not  causally  related  to  the  rest 
of  the  story  by  means  of  enabling  conditions  or  other  causal 
connections  are  highly  expendable.  In  "The  Vfar  of  the  Ghosts"  the 
initial  hunting  script  functions  only  to  set  the  scene  and  introduce 
the  main  characters.  No  subsequent  causal  dependencies  arise  from 
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these  script  activities.  In  the  three  Bartlett  paraphrases  which 
omitted  the  hunting  script  altogether,  the  scene  was  set  with  a simple 
locational  description. 

Free  recall  errors  are  often  surprising  in  the  ways  that  they 
defy  the  bounds  of  possibility.  For  example,  one  of  Bartlett's 
subjects  produced  a paraphrase  for  "The  War  of  the  Gnosts"  in  which  Ml 
goes  home  after  the  conversation  with  the  warriors,  and  then  reappears 
in  time  to  accompany  M2  home  after  the  battle,  as  if  they  had  never 
parted  company.  This  major  lapse  In  consistency  can  be  explained  in 
terms  of  faulty  updating  to  a memory  expansion  marker.  In  the  script 
instantiation  Kernel  for  the  war  party.  Ml  and  M2  were  originally  both 
candidates  for  the  role  of  attacking  warriors.  Wnen  Ml  went  home,  the 
memory  expansion  marker  should  have  been  updated  by  removing  Ml  from 
this  role  binding.  If  such  an  update  is  not  made.  Ml  will  presumably 
go  on  to  participate  In  tne  war  party,  and  then  return  home  with  M2. 
Exactly  when  such  updating  oversights  arise  is  a problem  of  some 
complexity,  but  we  might  expect  them  to  occur  most  frequently  in 
situations  where  multiple  role  bindings  are  split  up  after  a period  of 
shared  roles.  In  this  case.  Ml  and  M2  had  been  sharing  the  role  of 
nunters,  and  were  largely  indistinguishable  characters  up  until  the 
point  where  M2  was  hit  by  the  arrow. 

8.  Memory  Configurations 

Me  have  discussed  now  processing  at  the  time  of  understanding  can 
generally  effect  tasks  like  question  answering  and  paraphrase 
production.  Each  of  the  four  dynamic  memory  structures  are  expected 
to  affect  specific  recall  phenomena.  In  addition  to  their  isolated 


Page  33 


affects,  it  is  highly  likely  that  particular  configurations  of  dynaiic 
memory  structures  will  be  associated  with  specific  recall  behavior. 
For  example,  consider  once  again  "Tne  War  of  the  Ghosts"  and  our  hero 
who  felt  no  pain  when  hit  by  an  arrow.  His  fellow  warriors  see  that 
he  was  hit,  and  they  take  him  back  to  the  village.  Once  home,  he 
proceeds  to  build  a fire,  and  tell  the  villagers  about  the  his 
adventures.  The  next  morning  he  dies. 

As  we  saw  earlier,  an  expectational  trace  is  set  up  by  the  event 
of  being  hit  when  our  expectations  about  physical  harm  are  violated. 
This  expectation  is  explicitly  violated  when  we  are  told  he  felt  no 
pain,  and  then  it  is  implicitly  violated  again  when  we  hear  that  he 
went  home,  built  a fire,  and  told  his  story  as  if  nothing  violent  had 
happened  to  him.  Bub  eventually  he  dies  and  our  expectation  is 
finally  substantiated.  Now  we  have  a striking  memory  configuration: 
an  expectational  trace  was  maintained  for  some  length  of  time,  and 
then  was  transformed  into  a predictive  residue.  The  reader  in  this 
case  is  liable  to  experience  an  "I  thouvht  so"  reaction,  and  we  can 
expect  the  events  connected  to  this  configuration  to  be  well  preserved 
in  memory.  In  general,  we  could  predict  that  any  transformation  from 
an  expectational  trace  (£T)  into  a predictive  residue  (PR)  will  be 
granted  a high  priority  for  retention.  Exactly  how  high  depends  on  the 
strength  of  the  trace  and  tne  amount  of  time  elapsed  between  trace 
generation  and  residual  transformation.  In  our  excerpt  from  "The  War 
of  the  Gnosts”  we  would  have  roughly  the  following  corresponding 


events: 
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£vent1:  Hull  is  hit  oy  an  arrow 

EventA:  Huai  suffers  a negative  physical  state  change 

Events:  Huai  experiences  pain 

Event 2:  Huai  goes  hoae 

Event3:  Huai  builds  a fire 

Event4:  Huai  tells  his  story 

Events:  Huai  dies 


In  our  story  representation  these  events  would  be  organized  as 
follows: 


DYNAMIC  HEMOaY  CHRONOLOGICAL  STORY 

CONflGURATION:  REPRESENTATION: 


DERIVED  CAUSAL 
CONNECTIVITY: 


£T > PR 

transforaation 


Event  1 

ET  (EventA,  Events,  etc.) 

EventP 

Event 3 

Event 4 

Events  (=  EventA) 


Event  1 


result 


Events 


As  we  can  see  from  this  exaaple,  dynamic  memory  configurations  of 
this  sort  are  also  powerful  because  they  subsume  causal  relationships. 
We  suspect  that  our  main  character  died  because  he  was  hit  by  an 
arrow.  Tnis  causal  connection  is  established  whenever  two  events  are 
linked  by  a transformation  from  expectational  trace  to  predictive 
residue.  Other  configurations  will  embed  other  causal  links.  Given 
this  relationship  between  dynamic  memory  configurations  and  causal 
relatlonsnips,  the  causal  connectivity  analysis  proposed  by  Schank 
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[23]  snould  dove-tail  nicely  with  Jiemory  predictions  oased  on  dynaaic 
aeaory  representation. 

Configurations  wnlcn  should  be  recognizeed  as  especially  salient 
meaory  constructs  Include: 

(1)  ETs  triggered  oy  ATMs 

"John  was  caught  in  an  elephant  staapede  but  he  wasn't  hurt." 

(2)  PRs  triggered  by  ATMs 

"John  was  caught  in  an  elephant  staapede.  He  was  killed." 

(3)  expectations  suspended  a long  time  before  becoalng  PRs 

"Jo.nn  was  caught  in  an  elephant  staapede."  (After  a 
ten  page  digression  we  are  told  that  he  was  killed.) 

(4)  ETs  transforaed  to  PRs 

M2  dying  In  "Tne  War  of  tne  Ghosts" 

(5)  mutually  exclusive  PRs 

"John  and  Bill  both  loved  Mary.  They  formed  a aenage-a-trols." 

By  analyzing  narratives  in  terns  of  dynaaic  memory  configurations 
and  collecting  paraphrase  data,  we  can  expect  to  arrive  at  a 
comprehensive  set  of  salient  configurations.  Tnls  is  clearly  an  area 
Where  paraphrase  data  on  reasonably  long  narratives  is  needed  to 
further  our  investigation. 

The  issue  of  dynamic  memory  configurations  is  important  not  only 
for  the  task  of  paraphrase , but  question  answering  as  well . The 
hierarchical  structure  of  predictive  residues  will  be  determined  in 
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part  by  salient  configurations  involving  those  residues.  Tne 
resulting  priorities  aaong  residues  will  therefore  reflect  structural 
properties  of  the  narrative's  content.  Because  the  identification  of 
Key  neaory  configurations  (such  as  1-5  above)  will  subsume  a 
sensitivity  to  content,  it  follows  that  dynamic  semory  configurations 
will  reflect  salient  components  of  the  memory  representation  and 
control  access  to  tnose  components  accordingly. 

9.  Additional  Problems 

It  should  be  clear  that  the  representational  strategy  being 
proposed  here  raises  a great  many  questions  about  processes  at  tne 
time  of  understanding  as  well  as  questions  about  the  nature  of  memory 
degradation  over  time.  While  many  of  these  questions  have  oeen 
touched  upon  in  the  course  of  this  paper,  a few  more  deserve  to  be 
raised  at  this  point. 

Prom  a broad  perspective,  we  are  interested  in  designing  story 
representations  and  access  strategies  which  will  account  for  free  and 
cued  recall  phenomena.  More  information  about  a story  can  be  elicited 
in  cued  recall  (question  answering  dialogues)  than  in  free  recall 
(paraphrase  generation).  We  would  somehow  like  to  be  able  to  account 
for  this  general  discrepancy. 

In  discussing  memory  representations  and  processes  of  memory 
access,  it  is  not  always  clear  whether  or  not  a specific  task  is  being 
assumed.  It  is  usually  clear  when  someone  is  talking  about  question 
answering  behavior;  but  it  is  far  less  clear  when  a discussion 
implicitly  assumes  free  recall  tasks.  For  example,  Schank's  article 


"The  StruoLure  of  Episodes  in  Memory"  [23]  addresses  free  recall 
access  without  explicitly  acknowledsing  the  fact  that  this  is  only  one 
aspect  of  memory  access.  In  this  paper  we  are  given  rules  like 
"dead-end  causal  chains  are  liable  to  be  forgotten,"  and  we  understand 
from  context  that  information  in  such  a chain  is  liable  to  be  omitted 
in  paraphrase  production.  No  claims  are  made  about  whether  or  not 
this  information  is  available  for  processes  engaged  in  question 
answer! ng. 

We  must  assume  that  for  every  story  (of  sufficient  complexity) 
there  will  be  some  class  of  information  in  the  story  representation 
wnich  is  not  accessed  for  paraphrase  production  but  which  can  be 
accessed  for  answering  questions.  Access  in  free  recall  involves 
moving  from  one  concept  to  another  in  memory.  If  a concept  is  not 
causally  connected  within  a chain  of  events,  it  will  not  be  attached 
to  that  chain,  and  may  therefore  be  "forgotten."  At  the  same  time,  a 
question  that  "cues"  such  a concept  might  lead  us  right  to  it, 
regardless  of  whether  or  not  it  was  accessible  from  other  concepts. 

This  cuad  access  facility  is  exactly  what  predictive  residues  are 
designed  to  provide.  We  can  think  of  a story  representation  as 
sometning  that  resides  in  memory  with  internal  links  (causal  chain 
connectives)  for  free  recall  and  external  links  (predictive  residues) 
for  cued  recall.  The  internal  links  across  concepts  allow  us  to 
traverse  causal  chains  and  scenarios  within  the  representation,  while 
the  external  links  allow  us  to  Jump  into  specific  pieces  of  the 
representation  on  the  oasis  of  information  contained  in  a question. 
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While  the  internal  links  preserve  properties  of  causal 
connectivity  and  chronological  orderings,  the  external  links  are 
organized  in  a discriminating  structure  based  solely  on  the  Internal 
representation  for  specific  events.  So  a story  with  12  PTRAN3  events 
will  have  these  events  clustered  together  in  the  hierarchical 
arrangement  of  predictive  residues  regardless  of  their  dispersal  in 
the  internally  linked  structure.  The  precise  implementation  of 
competing  residues  remains  to  be  formulated,  but  there  are  two  obvious 
strategies.  (1)  Predictive  residues  may  be  structurally  organized  in 
terms  of  a discrimination  net  vrtiich  is  searched  during  parsing,  or  (2) 
they  may  be  dynamically  accessed  by  a production-based  parser.  This 
issue  of  Implemenatlon  will  be  tackled  when  we  build  a computer 
program  that  accesses  dynamic  memory  during  question  answering.  But 
beyond  this  question  of  Implementation,  other  problems  remain  which 
are  independent  of  the  precise  computational  mechanisms  employed. 

First  of  all,  there  is  the  problem  of  accessing  parts  of  the 
story  representation  that  were  not  predicted  at  the  time  of 
understanding.  Predictive  residues,  as  we  have  describd  them,  extend 
only  to  the  class  of  information  that  was  expected  by  a predictive 
knowledge  structure.  But  we  clearly  need  to  be  able  to  answer 
questions  about  events  that  were  totally  unexpected.  If  we  hear  about 
a singing  snake  in  the  context  of  a hunting  trip,  we  should  clearly  be 
able  to  remember  that  snake,  in  spite  of  the  fact  that  there  were  no 
predictions  anticipating  the  snake's  appearance.  This  situation  will 
arise  whenever  an  ATM  is  encountered  which  is  an  ATM  by  virtue  of  its 
unanticipated  nature. 
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Ttiis  suggests  tnst  some  residues  must  be  contructed  "on  the  fly" 
in  response  to  unanticipated  information.  Tnese  "spontaneous 
residues"  will  tnen  oe  integrated  witn  tne  predictive  residues  as  if 
they  were  derived  no  differently.  But  we  might  expect  to  find 
processing  limitations  on  the  number  of  spontaneous  residues  a reader 
can  construct.  Such  a limitation  will  manifest  itself  in  the  recall 
difficulties  we  previously  attriouted  to  "ATM  overload."  When  too  much 
unanticipated  information  occurs  over  an  interval  of  processing  time, 
tne  construction  of  spontaneous  residues  might  be  sacrificed  so  that 
the  system  can  "keep  up"  with  some  minimal  rate  of  input  information 
flow.  If  no  residues  are  produced  for  a set  of  ATri's,  it  will  not  be 
possiole  to  access  these  ATM's  for  either  question  answering  or 
paraphrase  proauction.  Alternatively,  partial  residues  might  oe 
constructed  wnicn  will  allow  limited  access  during  question  answering, 
only  if  tne  rignt  "cue"  is  present  in  the  question. 

The  proolem  of  partial  residues  (either  predictive  or 
spo'-' ar.eous)  raises  anotner  interesting  set  of  problems.  Precisely 

goes  into  a residue  in  the  first  place?  Subjects  frequently  fail 
to  a..'swer  questions  which  are  underspecified  wnen  a liore  specific 
question  will  suffice  to  "Jostle"  their  aemory.  For  example,  a 
subject  who  fails  to  sueoon  Information  in  response  to  "What  did  John 
tell  Karen?"  might  then  proceed  to  remember  the  interaction  if  next 
asked  "Wny  did  Jo.hn  lie  to  Karen?"  Such  question  answering  behavior 
can  be  analyzed  to  tell  us  precisely  what  informational  components  are 
present  in  a residue.  At  the  same  time,  evidence  for  particular 
representational  strategies  can  oe  derived  from  such  data.  For 
example,  if  a representation  for  "making  an  excuse"  is  structurally 
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similar  to  the  raprer<entatlon  for  "telling  a lie,"  then  a residue 
Tormulated  in  terms  of  the  former  might  be  triggered  by  a question 
stated  in  terms  of  the  latter.  Questions  about  necessary  and 
sufficient  similarity  conditions  across  representations  could 
therefore  oe  investigated  by  varying  question  cues  and  examining  the 
resulting  answers  provided  by  a namber  of  subjects. 

The  process  of  integrating  new  residues  at  tne  time  of 
understanding  also  raises  significant  issues,  we  do  not  expect  to 
accumulate  residues  into  an  unstructured  list  wnicn  will  then  be 
reorganized  into  hierarchical  priorities  after  the  text  is  completed. 
The  process  of  hierarchical  ordering  must  oe  completed  as  the 
narrative  is  processed,  with  old  information  being  reordered  as  new 
information  comes  in.  In  this  way,  information  which  seems  important 
at  tne  time  it  is  read  may  be  ultimately  assigned  a low  priority  as 
subsequent  information  supercedes  it.  Witnin  this  framewor’ic, 
everything  in  the  narrative  can  be  present  in  memory,  while  only  a 
limited  portion  of  this  information  may  oe  accessible.  A hierarchical 
cut-off  can  occur  at  the  Nth  level  which  renders  information  witn 
priority  lower  tnan  N inaccessible.  Tnis  sort  of  mechanism  is 
necessary  when  long  narratives  (like  War  and  Peace)  are  processed. 
Tne  access  cutoff  need  not  be  an  abrupt  mandate:  information  at  tne 
N-t-lst  level  might  be  accessible  only  if  the  residue  is  activated  "very 
precisely"  wnere  precision  is  measured  in  terms  of  the  number  of 
necessary  tests  completed.  Information  at  the  N-»-2nd  level  could  then 
be  accessed  only  oy  "totally  precise"  activation  cues.  In  this  way 
proolems  of  variable  access  can  be  investigated  in  terms  of 
hierarchical  priorities  on  the  residues  and  the  relative  strength  of 
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activation  cuss  in  a question. 

Witnin  tne  franework  of  variable  access  outlined  above,  certain 
pnenooena  in  ae.Tiory  degradation  sight  be  easily  aodelled.  For 
exasple,  loss  of  cued  access  over  time  might  be  merely  of  function  of 
tnresnola  raising.  After  one  week  access  thresholds  might  move  up  one 
level;  so  a cutoff  tnat  was  initially  at  tne  Nth  level  is  now  at  tne 
N-lst  level.  After  two  weeks  access  thresholds  may  be  altered  again, 
and  so  on.  At  some  point  in  time  we  would  expect  tne  thresnolds  to 
staoalize,  leaving  a relatively  permanent  access  potential. 

All  of  tne  above  problems  require  further  investigation  in  terms 
of  Dotn  tne  computational  moael  and  recall  data  on  narratives.  We 
nave  merely  toucheo  on  tne  range  of  recall  pnenomena  that  can  be 
investigated  in  terms  of  dynamic  memory  representations.  The  strategy 
outlined  is  primarily  a strategy  for  memory  access,  which  is  itself 
independent  of  any  particular  scheme  for  conceptual  representation. 
Witnin  this  strategy,  the  access  of  information  is  sensitive  to  the 
retrieval  task  at  hand  (question  answering  versus  parap.hrase) , tne 
relative  importance  of  the  information  sought  (its  priority  ranking 
witnin  tne  hierarchy  of  residues),  the  strength  of  a recall  cue  in  tne 
case  of  a question  asked  (necessary  activation  conditions  within  a 
residue),  and  tne  salience  of  information  for  the  purposes  of 
parapnrase  (dynamic  memory  configurations).  Witnin  this  computational 
framcworx  based  on  models  of  predictive  understanding,  it  is  possible 
to  formulate  questions  about  variable  memory  access  tnat  can  oe 
investigated  in  terms  of  both  computational  models  and  empirical  data 
derived  from  human  subjects. 
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